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ABSTRACT 

In this paper we will focus on the numerical methods involved in solving nonlinear equation in one variable and 
systems of nonlinear equations. First we will study the fixed point iteration and Newton’s method in one variable for 
solving nonlinear equation and their convergence. Second we will examine these two methods in for solving of 
multivariable nonlinear equations which involves the Jacobean matrix and finally we also give an application of Newton’s 
methods. 

KEYWORDS: Numerical methods of solving nonlinear equations. 

INTRODUCTION 

In general it is not possible to determine a zero of C, of a function / : E — > E explicit with a finite number of 
steps, so we have to restore to approximation methods. This method are usually iterative [i.e. a trial of sequence] and have 
the following form. 

Beginning with starting value of X <0) successive approximation X ' , i = 1,2, ■••to ^ are computed with aid of 
an iteration function G : E — > E such that X ,+l = G( X ' ) . 

The Following Question Arises in this Connection According to [4], 

How is a suitable iteration function to be found? 

Under what conditions the sequence X ' will converges? 

How quickly will the sequence X ' converges 

In this seminar is to examine two different numerical methods that are used to solve nonlinear equation in one 
variable and systems of nonlinear equations in several variables. The first method will look at the fixed point iteration 
methods this will be followed by Newton’s methods. For each method, a breakdown of each numerical procedure and 
theorems will be proved. In addition, there will be some discussion of the convergence of the numerical methods, as well 
as the advantages and disadvantages of the Newton’s methods. 


Impact Factor(JCC): 3.6754 - This article can be downloaded from www.impactiournals.us 



| 42 Dereje Negussie 

PRELIMINARIES 

Some useful Definition and Theorems 

Definition-1 The general form of a system of non linear system of equation is: 

/i(*i, = 0 

f 2 (x v ---,x n ) = 0 

< . (l.l) 

/„(x 1 , — ,x n ) = 0 

Where each f i ,i = i,2,...,n be mapping a vector X = (x { ,- ■ ■ , X n ) T of the n-dimensional space R” into the real 

line. 

The system can be alternatively be represented by defining a function mapping R n into R" by: 

F(x l ,---,x n ) = (f l (x l ,---,x n ),---,f 2 (x l ,---,x n )) T 


Using vector notation to represent the variables x l ,x 2 ,---,x n system (1.1) assumes the form 
F(x)=0 (1.2) 

The function f \ , / 2 , ■ ■ • , f n are called the co ordinate function of F. 

Example: The three -by-three system of nonlinear equation 


3x 1 - cos(x 2 )x 3 - = 0 

x 2 i — 8 l[Xj +0.1] 2 + sin(x 3 ) + 1.06 = 0 


+ 20x 3 + 


10^-3 


= 0 


The above equation can be replaced in the form by defining the three function f x ,f^,and / 3 from 

R 3 in to R 


f \ (*^i s ’ * * ? ) 3 A' | COS(x* 2 )x 3 ^ 

< f 2 (a*i x n ) — x 2 i — 81[Xj + 0.1] 2 + sin(x 3 ) + 1.06 

/ 3 (a-i , • • • , x J = e - * 1 * 2 + 20 x 3 + l0/r 3 

3 And /i? 3 — > R 3 

F(x 1 ,---,x n ) = (f l (x 1 ,---,x n ),f 2 (x 1 ,---,x n ),f 3 (x 1 ,---,x n )) T 

1 9 9 . 10 7T — 3 T 

= (3x, -cos(x 2 )x 3 - — ,x 1 _ 81[x, + 0.1] + sin(x 3 ), e X,JC2 +20x 3 H — ) 
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Defination-2 : Let f be a function define on a set D ci?” and mapping into R.The function f is said to have the 
limit L at X Q written lim /(*) = L if given any number £ > 0, a number 8 > 0 exits with property that 

| / (x) — L| < £ whenever X 0 £ D and ||x — X 0 1| < 8 

Mean Value Theorem 

If f £ \ci,b\ and f is differentiable ob [a, b], then a number C, in such that Cl < ^ < b exists such that 

f '{£, ) — ^ ^ — — — — where C[a,b] is the set of all continuous function on [a,b] 
b-a 

Intermediate Value Theorem 

If f e \ct,b\ and y is any number between f (a) and f(b),then there is x in (a,b) for which f(x)=y 

Jacobean Matrix 

Let E be n-dimensional with a base e x , e 2 , • • • , e n and corresponding coordinate X l ,X 2 , m ", X n and Let F be m- 

dimensional with base e x ,e~, m and corresponding coordinate X \,---,X m .Let Gc £ be open set and let 

f : G — > F ,in terms of coordinate, we may written the mapping f as 

x i~ =/iUi, 

X 2 ~ = f 2 {x x ,---,X n ) 

X n~ =fn( X 

If f s differentiable at X E G ,then it is differentiable at X is given by the matrix 


d/l 

d/i 

dx x 

dX n 

dfn 

dfn 

3xj 

dX n 


Hessian Matrix 

The Hessian matrix, will be discussed in a future proof 

Definition: The Hessian matrix is a matrix of second order partial derivative H 


d 2 f 

dxdx , 

' J 


Such that 
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H(x) = 


ay 

d.x 2 i 

ay 


a 2 / 

ay 


Norm 

Definition 3: A norm on /?" is a real -valued function ||.|| define on R" and satisfying the three conditions 
below [where before O denote the zero vector in R n \ 


1. x > 0 and x =0 iff x = 0 


2. CKV = \OC X ,for any scalar OC and vector x. 


3. ||x + y|| < ||x|| + | y|| ,for all vectors x and y 

The quantity ||x|| is thought of as being a measure of the size of the vector X and the double bar are used to 
emphasize the distinction between the size of the vector and the absolute value of a scalar. 

Three useful examples of norms are the so-called l p norms ||| for R " , p = 1,2, °° 


I4=ZK- 


r n \ 



x]^ = max{|x ( |},/ = l,2,---,n 

Norm of Matrix 

Definition 4: Let M n denote the set of all (nxn) matrix and let O denoted the (nxn) zero matrix. Then a matrix 

norm for M n is real valued function || || which define on M n and will satisfy the following condition for all (nxn) 
matrices A and B 

1. ||a|| > 0 and ||a|| = 0 iff A = 0 

2. \\aA\\ = |tf||A||| .for any scalar OC 

3. |A + fi| < |A| + and ||Afi|| < ||a|||b|| 
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Just as there are numerous way of defining specific vector norm, there also way defining specific matrix norm. 
We concentrate three basic matrix norm specially if {a jj )g M n .Then 


L ML = Max 


1 < j<n \_ i = 1 


I 


a. 


2 . 


A 


Max 

\<i<n 


II 

7=1 


£ 7 ,, 


— > Maximum absolute column sum 


— > Maximum absolute row sum 


3. A 


XXI 

1 /=1 7=1 


General Convergence 

A sequence of vectors {x n } € R" converges to a vector X ,if for each £ > 0 there is an integer N (£) such that 
M - < £ for all n > N {£ ) . 

In order to characterize the speed of convergence of a convergent sequence X n lim x n = x ,we say that the 

n— >oo 

sequence converges at least with order p > 1 if there is a constant c>0 with if c< 1 if p > 1 and an integer N such that the 
inequality |x n — x|| < C||x n — ,0 < C < 1 holds for all i > N 

i) I f p = 1 , then order of convergence is linear. 

ii) If p — 2 , then the order of convergence is quadratic. 

The speed of convergence increase with decrease C. Therefore C is called convergence factor 

Taylors Theorem for function of one variable 

If f(x) is continuous and posses continuous derivative of order n in an interval includes x=a,then in that interval 


f(x) = f(a) + (x-a)f'(a) + (x-aY 


f\a) ( x-a ) 


n - 1 


-+••• + 


f in) (a) + R n (x) , the remainder term 


2 ! (77-I)! 


can be expressed in the form R n ( X ) = — — / t,!> (^), a < f < X. 


IV. 


Impact Factor(JCC): 3.6754 - This article can be downloaded from www.impactjournals.us 



46 


Dereje Negussie 


Taylor’s series for function of several variables 




/(*, +Ax l ,x 2 +Ax 2 ,---,x n +Ax n ) = f(x l ,x 2 ,---,x n ) + — Ax l +••• + 

dx 1 


df 1 
dx. " 2 


2 r ~\2 r ~\2 r ~\2 r 

J (Ax,) 2 +--- + Tr -^- + 2 - / Ac, Ac, H 1- 2- 4 — Ax„_,Ax„ 


3x 


dx 2 


dx 1 dx 2 


fan-fan 


n—\ n 


+ ■ 


ITERATIVE METHODS FOR NONLINEAR EQUATION IN ONE VARIABLE 

Fixed -point iteration 


We consider methods for determining the solution to an equation that is expressed for some iteration function in 


the form: 


g(x) = x whenever f(x) = 0 


( 2 . 1 ) 


A solution to such an equation (2.1) is said to be a fixed - point of the function g.If a fixed point could be found 
for any given g, then the every root finding problem could be solved. 

The construction of the iteration function g is not unique 
For example if f ( X ) = X — 1 3 JC + 18 = 0 

Then possible choice for g(x) might be to list a few: 

(x 3 +18) 


£(*) 


13 


. g(x) = (13x-18) 


£(*) = 


(13^ 2 -18) 


In this case if f(£) = 0 iff £ = g{Z) and g is said to be a fixed point of g(x). 


Starting with a suitable initial value X 0 to expected root, compute 

A = g(x „), x 2 = gO,), ••• in general x n+l = g(x„) 

The sequence j X, : } of numbers converges to £, under a certain condition and this E, is the required solution. This 
method is called fixed point method. 

Definition 2.1: A point C, is called a fixed point of iteration function g(x) iff g(^) = E, . 

The following theorem gives sufficient condition for existence and uniqueness of fixed point. 

The following Theorem taken from [6] 
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Theorem 2.1: [Fixed point theorem] 

Let g(x) be an iteration function define on the interval I =[a,b] such that 

. g(x)e I for all xe I 

• a < g(x) < b for all x,a < x <b 

• The function g(x) is differentiable on I (implies continuity on I) and there exists a positive number k<l such that 
|g'(*)| ^ k < 1 for all xe I 

Then 

• g(x) has a fixed point £ in I 

• fixed point £ is unique. 

• Sequence generated by the rule X n+I = g(x n ) starting with initial X {) € / converges to the fixed point f . 

PROOF 

Existence 

If g(a) = a or g(b ) = b ,the existence of a fixed point is obvious. 

Suppose not. Then it must true that g(a) > a and g(b) < b. Define h(x) — g(x) — X ,h is continuous on 
[a,b] since g(x) and x are continuous on [a,b].More over h(a)=g(a)-a>0 and h(b)=g(b)-b<0.By intermediate value theorem 
there exists f in (a,b) for which 

K€) = g(€) -g = o^ g(£) = g 

Therefore g has fixed point. 

Uniqueness 

Suppose and are two distinct points of g(x) in I, then f = g(£ t ) and g 2 = gif *, ) . 

Then f = g (£ x ) — g(<^ 2 ) and by mean value theorem for some OC € ( a,b ). 

% - #2 1 = \g'(a )(£ i - # 2 1 ^ \g\a% ~ & | ^ 1 

=> 1^1 — #a| < |#1 — ^1 since \g'(a)\<k<l 

A positive number less than itself which is impossible. 

Therefore, the assumption that ^ and f 2 are distinct is false 
Hence £ = 
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I.e. fixed point is unique. 

Convergence 

From (a) a fixed point f of g(x) exits g(<%) = 


X — Q ( X ^ 

«+i 6 v- n > Sj nce g( x o iteration function 


^ g(^) > ^ i s a fixed point of g(x) 

^£~X n+ i =g(£)~g(x n ) 

=J> e n+l = (^ — X n )g'(OC n ) , CC n lies between X n and £ by mean value theorem 

e „ + 1 = e ng'(a n ) ^ ke n => Kl\ ^ k \ e n\ 


k + ip%„ 


< k 2 \e„ 


By using the above in quality 


<k 3 e 


n—2 


k + i|^^" +1 k| 


limk+i =0since limfc " +1 =0 


lim|<f-x 


n +1 


limx„ +1 =# 


Therefore the sequence converge to £, 

Theorem 2.2: Let g(I) Cl I and ^ k < 1 for all XE I .Forx 0 E I ,the sequence X n+l = g(x n ) 

,n= 1,2,... converges to a fixed point t, and the n th error e — X n — C, and satisfies 


k" I 

^=7TFi -*o 
1 — k 

Proof we proved the convergence a sequence { X n } converges to a fixed point iff .Now we want to prove the n th 
error estimation. 

From the sequence X n+l = g(x n ) 
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Now \x 2 -XjI = |gO 1 )-,g(x 0 )| <k\x x -x 0 | [ using mean value theorem ] 

=>| x 2 -x 1 \<k\x 1 -x 0 | 

And \x 3 —X 2 \ < |g(T 2 ) _ g( x i)| - k\ x 2 _x i| - ^ 2 | x i ~ x o\ 

=> — x 2 1 ^ k - Xq | 


\X n+l — X n < k " X, — X 0 , [By induction] 

By several application of triangle inequality we get, 

m 

\ X n + m- X n\^Tj\ X n + r- X n + r-l\ 
r = 1 

m 

r = 1 

m 

r = 1 


limx n+ m-x n 


srk-x„| lim (T, k 1 1 ), since k<l 


m — >oo r = i 


|£- x J^"k - x o 


, since Hm X , = 

m—>oo 


Therefore e„ < 


i -r 


Convergence of Fixed Point Iteration 

Theorem 2.3: if g(x) be the iteration function X n+1 = g(x n ) is such that g' (x) is continuous in some 
neighborhood of a fixed point E, and g'(l A 0 .then fixed point method converges linearly. 


Proof: Let e n e the error in the n th approximation i.e e n — E ~ X n 
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^n + 1 T % n+ \ 

= g(£)-g(x„) 

Then = g(^) - \ g(^) - e n g\ £) + higher order derivative } 

= e n gX£) 

g'(£) | = c 

Therefore the fixed point convergence is linearly. 

The following example taken from [4] 

Example 1: Find the root of the function f ( x ) = 2x — COS X — 3 = 0 , correct to four decimal places on the 
interval [— 71, 7t\ 

Solution: first rewrite the equation in the form x=g(x) 

COS X + 3 , . 

=> x = , the iteration junction 

, , cos x + 3 

g(x) = 



And using fixed point theorem |g , (.tc)| 


sin* 


< l,Vjte [-7T, 7t\ . 


Hence there exist a unique fixed point in [ — JI, 7t\ and we iterate using X n+l = g(x n ) with starting point 
Xq £ [ 71, 7r\ . 


Let X 0 


7t 

2 
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The Results are given in the Following Table 1 


Table 1 


N 


x „ + 1 

0 

n 

2 

- 

1 

1.5 

7x1 0 -2 

2 

1.5354 

3.54xl0“ 2 

3 

1.5177 

1.77xl0“ 2 

4 

1.5265 

8.8xlCT 3 

5 

1.5201 

4.4xlCT 3 

6 

1.5243 

2.2xl(T 3 

7 

1.5232 

1.1x10 3 

8 

1.5238 

6x10 4 

9 

1.5235 

3x10 4 

10 

1.5236 

£T 

o 

i 


Therefore, the solution is E, — 1 .5236 

Example 2: An engineer might want to find the pressure needed to cause a fluid suspension of particle to flow 
through a pipe, its diameter, the quantity of fluid that is to flow, and a number called the friction factor / that has been 
determined from experiment. The following nonlinear equation can be computed the friction factor / . 


1 _ 1 
4f~ k 


\n(RE(Jf) + \4 


^6 

k 


(*) 


Where the parameter k is known and RE is so called Reynolds number, can be computed from the pipe diameter, 
the velocity of the fluid. Then what is the value of f if k=0.28 and RE =3750. 


Solution: first we have to find the suitable iteration function g from ( *) by analytic methods 


8(f) 


0.14V7 


/ 


+- 0.84 


61.237 


M /q 


0.1 and Tolerance(€ = 10 9 ) 
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The Results Given In the Following Data Table the Out Put the Results 


Table 2 


N 

fn 

/„+, - fn 

0 

0.1 

0.041106981 

1 

0.058893019 

0.01788495 

2 

0.041008069 

0.034508069 

3 

0.075516138 

0.012560378 

4 

0.0629557595 

3.1 3x1 0“ 3 

5 

0.066087062 

8.78x10 4 

6 

0.065208764 

2.39x10 4 

7 

0.065447557 

6.55xl0~ 5 

8 

0.065382071 

1.79xl0“ 5 

9 

0.065399987 

4.9xl0“ 6 

10 

0.065395082 

3.6xl0“ 6 

11 

0.065396425 

1.34xl0“ 6 

12 

0.065396057 

l.OlxlO -7 

13 

0.065396158 

2.7xl0“ 8 

14 

0.065396131 

7xl0“ 9 

15 

0.065396138 

2x1 0" 9 

16 

0.065396136 

lxl 0" 9 





Therefore,f=0.065396136 

Newton -Rapson Method of Iteration One Variable 

Let X 0 be the approximation root of / (x) and X } = X 0 + h be the correct root so that / (x, ) = 0 and 
expanding / (x 0 + h) by Taylor’s series we obtain: 


h 

/(x 0 ) + hf'(x 0 ) + — /(x 0 ) + higher derivative = 0 


Neglecting the second and higher order derivative we have: 
f(x 0 ) + hf\x 0 ) = 0 


Which gives? h = — 


fix q ) 

fix 0 ) 


Hence X[ a better approximation than x 0 is therefore 


fix o) 
fix 0 ) 
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Successive approximation are given by X 2 , ■ • • , X n , X +1 


/cu 

/'(*■) 


Equation (2) which is called the Newtons Raphson formula 


We indicate a geometric interpretation of Newtons method for the case that f(x), X 0 and the solution being sought 
are real. Geometrically, one step of Newton -Rapson method consists of replacing the curve y=f(x) the straight line 
y — f ( a ' 0 ) + f'( X () )(x — X f) ) which is tangent to the curve at the point X = X Q ,the approximation X n+x is the point of 

intersection of the tangent line the curve y=f(x) at the point X = X n with the X-axis. 

Convergence of Newton-Rapson Method of Iteration 

Theorem 2.4: if the iteration function g(x) is such that g"(x) is continuous in some neighborhood of a fixed 
point E, and g\4) = 0, then Newton’s method converges quadratic ally. 

Proof: Now e n+1 = %- X n+1 = g ( 4 ) ~ g(x n ) 


= 8(G)- 8(4 ~ x n ) sin ce x n = g - e„ 


= 8(4) 


g(4)-e„8'(4) + 


e 2 *g'(j) 

2 


+ higher order derivative 


Neglecting the higher order derivative, then we have 

e n+l - e 2 ,, ^ ^ , since g(£) = 0 and g"(£) - k > 0 


l^/I+l | 

k 

1 I 2 

hi 

2 


Therefore the convergence of Newtons-Raphson iteration method is quadratic ally. 

METHOD OF ITERATION FOR NONLINEAR SYSTEM OF EQUATION WITH N-EQUATION 
WITH N- VARIABLE 

This section is concerned with the solution of n-simultaneous nonlinear equation in n -variable. 

Such problems arise in a large varity of ways and varity of methods are necessarily to treat them. 

We just introduce the subject give of these methods in chapter -2 fixed point iteration and Newton’s methods in 
one variable. 
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Fixed point for n-equation with n-unknown 

Suppose we have a system of nonlinear equation 

f 1 (x 1 , — ,x n ) = 0 
f 2 (x l , — ,x n ) = 0 




(3.1) 


Suppose these equations have a solution , ■ ■ • , £ ) T = f 
Re write this equation in equivalent form 

*1 =g l (x 1 , — ,x n ) 

*2 =8 2 ( X l> — > X n) 


X n =8n( X — 


(3.2) 


The solution (3.1) and (3.2) has the same solution 




and let X (A * = (Xj * k \ ■ ■ ■ , X^ k) ) be the k th 


approximation of 

, (*+i) 


with construction of the iteration scheme 




.(3.3) 




Equation (3.3) can be written in compact form 


X iK+l) =G(X (k) ) 


( 3 . 4 ) 


where X 


(K+ 1 ) 


(x^'\-,x,r"Y , G(X‘*') = ( gl (x,' g,(x"’)' and X 


(*+l) \ T 


’(K) 


(*)> 


Ak)\T 


(K) 


(x«\-,x n w ) T 


For k=0, 1,2... 

The following theorem extends the fixed point theorem in chapter 2, to the n-dimensional case. This theorem is a 
special case of the well known contraction mapping. 

Theorem: Let D — { (Xj , • • • , x n ) T / a, < X, < b , , for each i = 1 , 2 , ■■•,«} for some collection of constant 
a l ,---,a n and b x , Suppose G is a continuous function with partial derivative from D CZ R n with the property 

that G(X)e D whnever xe D.Thcn G has as fixed point in D,moreover,suppose a constant 0<m<l exits with 


NAAS Rating: 3.00- Articles can be sent to editor @impactjournals.us 



Numerical Methods for Solving one Variable and Systems of Nonlinear Equations 


55 


dg,(x) 


dx . 


m 


< — , whenever D for each j= 1,2,..., n and each component function g t ■ . Then the sequence {x }“ =0 
n 


define by arbitrary selected x (0) in D and generated by X' f '" = G( X ' K ! ) for each k > 0 converges to the unique 


(x+b _ 


'UOn 


m 


point D and ||x W -3 <— — |x U> -X (0) ' 

I! Iloo i _ m I 1 


. Taken from [3] 


Proof: The proof is similar to the fixed point theorem in chapter 2 the only difference we use the norm||.|| 
The following example taken from [3] 

Example: Consider the following the nonlinear system of equations 


3.X] -cos(x 2 x 3 ) = 0 
xf -81(x 2 +0.1)“ + sinx 3 +1.06 = 0 


+ 20x, + 


10# -3 


0 


If the i equation is solved for X, ,the system can be changed into the fixed-point problem 


1 , , 1 

*1 =- COS ( X 2 X 3 ) + - 




+ sinx 3 +1.06-0.1 


x 3 = — e x,Xl - ( 

3 20 


10# -3 
60 


) 


LetG :R — > R 3 e define G(x) = (g fx), g 2 (x), g 3 (x)) T and X = (x l ,X 2 ,X 3 ) T .where 


, , 1 , ,1 

gfx 1 ,x 2 ,x 3 ) = - cos(x 2 x 3 ) + - 


g 2 (Xj , x 2 ,x 3 ) = ^ -\jx j + sin x 3 + 1 .06 -0.1 

, X -1 -n ,10# -3. 

g 3 (x l ,x 2 ,x 3 ) = —e 12 ~( ) 

zU bU 


Using the above theorem (3.1) will be used to show that G a unique fixed point in 

,r 


D = {(xj,x 2 ,x 3 ) /-I < x < 1 ,foreachi = 1,2,3} 


Now for x = (Xj , x 2 , x 3 ) T e D 
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g l (x l ,x 2 ,x 3 ) < ^|cos|(x 2 x 3 ) 


+ -<0.5 

6 


| g 2 (x 1 ,jc 2 ,jc 3 )| < ^ ^/l + sin(l) + 1,06 + 10. l| < 0.29 < 0.3 


|^ 3 (jc 1 , JC 2 , JC 3 )| 


< 


1 10^-3 

— e V2 + 

20 60 


<0.61 


So -1 < g i (x l ,x 2 ,x 3 ) < 1, for each i = 1,2,3- Thus G(X)e D whenever xe D.Finding bounds for 
the partial derivative on D given the following. 




dg 2 


dg 3 

dx l 


dx 2 


dx 3 


= 0 


While, 


a* 


r)x n 


< ^■|x 3 ||sin(x 2 x 3 )| < 0.281 


dg 2 



dx 3 



dg 3 


— e 

dx 2 


20 

dg 3 





20 


COS X 


3 


<0.119 


+ sinx 3 +1.06 


<0.14 


--^2 < () |4 


Since the partial derivative of g l ,g 2 andg 3 are bounded on D and g l ,g 2 andg 3 are continuous on D 
consequently G is continuous on D. 


Moreover, for every X e D, 


dgj(x) 

dx: 


< 0.281, for each j,i = 1,2,3 and the condition in the second part of 


Theorem (3.1) holds m=0.281X3=0.843<l. 


Therefore, G has a unique fixed point in D and the nonlinear system of equation has solution in D. 

Note that G having a unique solution in D does not imply that the solution to the original system is unique on this 
domain. For example the solution X 2 in the above example involved the choice of the principal square root (the positive 
square root). 


To approximate the fixed point f we will choose 
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jcj ( * +1) = ^■cos(x 2 a) X3 (A) ) + ^ 

x 2 (k+1) = ^(X^) 2 +sinx 3 (i) +1.06 -0.1 

„ (*+d _ - 1 „-*,<*> x 7 ^ ^io^-3^ 

3 20 60 


The sequence was generated until k was found with tolerance: 
< 10“ 5 


£ = 


x (k+l) -x (K) 


The Results are Given in the Following Table 


Table: 3 


K 


* 2 W 

JC 3 W 

( AT+1) ( K ) 

0 

0.1000 

0.1000 

- 0.1000 


1 

0.49998333 

0.00944115 

0.52310127 

0.423 

2 

0.499999593 

0.00002557 

0.52336331 

9.4*1 0 -3 

3 

0.50000 

0.00001234 

0.52359847 

2.3*10' ~ 4 

4 

0.50000 

0.000000003 

- 0.52359847 

1.2*10^* 

5 

0.500000 

0.000000002 

- 0.52359877 

3.1xl(T 7 


Hence £ = (0.5,0.000000002, — 0.52359877) r .But the actual solution p =(0.5,0, ) T 

6 


Convergence Analysis of Fixed Point 

Let us consider the system of equation 

f 1 (x 1 ,---,X n ) = 0 

f 2 (x X„) = 0 

< _ 

fn(X l ,— ,X„) = 0 

And suppose the system of equation have the solution 

Rewriting (3.5) in equivalent form 


(3.5) 
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*1 =8i(x l , — ,x n ) 

*2 =8 2 (X — 

x n =g n (x 1 , — ,x n ) 

The iteration scheme can be written as: 


Xr k+1) =g iUi W ,-^i W ) 


x™=gM m "-'X™) 


And we have 




is a fixed point of- 


= 8 i (£,—.0 

< ; 

— 8 n ((? 1 ’ " ' ’ Tn ) 

Now subtracting (3.7) from (3.8) we have, 

' =g 1 (^,---,^)-g 1 (x I w ,--,x 1 w ) 


(3.6) 


-(3.8) 


And we have that 

(*+l) //e „ (fc) x , (*) /e „ (*K , „ (*)> 




£ --V = ^,((#1 -jO + *, w .-.(£ -x„ w ) + x„ w -g„(x W l,-,X n W ) 


(*K , „ (*) 


(*K , „ (*) 


,w 


(*)-. 


( 3 . 6 ) 


( 3 . 7 ) 


-(3.9) 


Since ^ = X { ] + e ( 1 and = X ; + <? J Expanding (3.9) by Taylors series of several variable at 

X <k> = (X\ K) , • •• , X n (K) ) and neglecting the second and higher order derivative term to 
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ox, dx„ 


l =sM m ,- W B )+(« 

dx i 


-( 3 . 10 ) 


In matrix form, the error equation becomes 


(*+i) A 


£“*i 


e _ (Jf+1) 






a*/*’ _ dx„ (K) 

ag,cO ' au>) 

dx l iK) dx 


(K) 




L ~ X n 


( k ) 


(3.11) 


Let J(X W ) 


ag, 5g! 


3x, 

ag„ 


a*„ 

ag„ 


3.x:, dx n 


Which is the Jacobean matrix of the function g, , • • • , g n at X (k ’ . 

T / (k+ 1) (ir+!),T it/ / (k) (k) \T , 

Let W k+<L = (X, , • ■ • , X n ) , W K = (X, , • • • , X n ) ,then we can write 

Z-w k+l =J{x w )(Z-w k ) ( 3 . 12 ) 

In(3.12),if W k is closed to ^ , then J(x ik) ) will closed to J (<%) ■ 

This will make the size of J (^) crucial in analyzing the convergent in (3.12) and it plays in the role of g \<g) in 
the theory of chapter -2. To measure the size of the error E, — W k and matrix J ( X 1 k 1 ) we will use the vector and matrix 


Returning to (3.12) we have 

Hence the convergent of fixed point is linear and the iteration for two unknown converges when||/(X 


(k) 


<1 


for each iteration. 

In order to convergences to be rapid enough to make the method advisable in any given it is necessarily that 
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quantity ||/|| be much less than 1 

Newton’s Methods 

We extend the method derived for single equation / (.v) = 0 to a system of nonlinear equation. 
Consider a system of n-nonlinear equation in n-unknown 


/i(*i, = 0 

f 2 (x l , — ,x„) = 0 


(3-13) 


Regarding the arguments x 1 ,---,x n as n-dimensional vector x — ( x l , ■ ■ ■ , x n ) ' .The entries 

f\ ’ ' ’ ' ’ fn As n-dimensional vector function and F(x ) = (f\ , • • • , f n ) T .We can write (3.13) compactly as 

F(x) = 0 (3.14) 


Let X <k> = (x, 1/1 , • • • , X^ k) )' is the k th approximation of the root X = (x l , ■ ■ • , X n )' of the vector equation 
can be represented as 

x = x w +e {k) (3.15) 

Where e (k) e n ) T is the correction or the error of the root 

From (3.14) and (3. 15), we have that ; 

F(x (k) +e (k) ) = 0 (3.16) 

Our aim is to find the value of e ik) using the k' 1 ' approximation X U " 1 so that (k + 1 ) ' h approximation is better 
than the k ,h approximation. 

Assuming Fix) is continuously differentiable in the domain containing X and X <k> and expanding each 
fj(x ik) +e ik) ) using Taylor’s expansion for function of several variable about X (k> . 


/i +e 1 {k) +-- + x n (k) +e n w ) = f l (x l ,-,x n ) + 


In the same way expand f 2 (x <k> + e ik) ),---uptO f n (x >k> +e ik) ). 


^/i(^ a> ( K) 

dx, (K) 6l 


+ ••• + 


dx w 


+ higher order 


(k) 

Since e t 


are relatively small number, neglecting square and higher power of 



we obtain a system of linear 
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equation as follow 

' a/ 1 (x (4) 


(« 1 


c)x , 

df n {x (k) ) < k) 


e r + - + df ’ (x 


(k) 


c)x 


(.k) 


6 , + • • • + 


dx n w 




-fn(.X?\-,X n (k) ) 


-(3.17) 


More compactly can be written as: 

F(x a) ) + F \x {k) )(e w ) = 0 (3.18) 

Where F'{x (k) ) can be considered as the Jacobean Matrix and it is denoted by 


J(X W ) = 


a/iU (t) ) a/,(x (t) ) > | 

a*/” 


(*) 


a/„(>) 

dx kk) 


' df,(x {k >) ' 

dx (k) 

v y 




And F(X W = [/, (*, W , ■ • • • , X n W ),-,/„ (Xj W , ■ - , ^ )f • 

Assuming the matrix 7(X 1 K) ) is non singular from (3.18) it follows 

e (k) =J~ l (X (k) )F(X iK) ) 


-(3.19) 


Which is the value of the correction interims of x a> .Since e ik) = x (k+>) — x ik} .Then (3.19) becomes 


<k+l) 


=x (k) -r L (x w )F(x w ) 


-!/,,(*)' 


,(*)' 


(3.20) 


Equation (3.20) is called Newton’s method for nonlinear system of equation. 

A definite weakness in the Newton’s method procedure arises from the necessity of inverting the matrix J(X) at 
each step. In practice, the methods is performed in a two step manner, first a vector Y 


Is found which satisfy 

J(X (k) )Y = -F(X (k) )- 


-(3.21) 


After this has been accomplished, the new approximation x (k+u can be obtained by adding to 

In equation (3.21) we solve for Y by linear system of equation by direct methods if the system is small and by 
iterative methods if the system is large for each iteration. The convergence of Newton’s method depends on the initial 
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approximation X * 0) 

Example: a) Take one step from a suitable starting point with Newtons method applied to the system 


10.* + sin(.* + y) = 1 
8y -cos 2 (z - y) =1 
12z + sinz = 1 


Suggest for fixed point method X ' k ’ * 1 = G(x' k ' ) and how many iteration are required to obtain a solution 
correct to six decimal point from starting point (a) 

Solution: we have the system of equations 

f x (x, y, z ) = \0x + sin(;t - y) - 1 = 0 
f 2 (x,y,z) = 8y-cos 2 (z-y)-l = l 
/ 3 (x, y, z) = 12z + sin z - 1 = 0 

To obtain a suitable starting point, we use the approximation 

sin(jc + y) ~ 0 
cos(z - y) ~ 1 
sin z ~ 0 


And obtain the given initial approximation 


_l_ _J_ _J_ 

~10' y ° ~4’ Zo “l2 


We have 


J k (*) 


"lO + cos(.*+ y) 
0 


cos(.v + y) 

8 - sin(2(z - y)) 
0 


0 " 
sin(2(z - y)) 
12cosz y 



"10.939373 

0.939373 

0 'l 



And 7 () = 

0 

8.327195 

-0.327195 




v 0 

0 

12.996530 j 




"0.091413 

-0.010312 

- 0.000260^ 


( 0.3442898^ 

v= 

0 

0.120089 

0.003023 


>F 0 = 

0.027522 


v 0 

0 

0.076944 

) 


v 0.083237 , 
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Using the Newton’s method 

/ + D = /)-/-i(/))F(/)) 

We obtain k=0 

x (1) =X (0) -J 0 ~ l F 0 

Hence x 1 = 0.0689, _y, = 0.246443, z, t = 0.076929 

we can write a fixed -point methods in the form 

Xik+>) = + y^ = Si(x k ,y k ,z k ) 

Y {k+ " =^[l-cos \z k -y k )\ = g 2 (x k ,y k ,z k ) 

Z iK+1) = ii [1 _ 1 sin z k ] = 83 (Xk ’ Yt ’ z k) 


Starting with initial approximation 


X (0) = 


"j_ i 
v 10’4’l2 y 


,we obtain the sequence of iteration. 


jc ( 1) = (0.0657 10, 0.246560, 0.076397) r 
x (2) = (0.069278, 0.246415, 0.076973) r 
x (3) = (0.068952, 0.246445, 0.076929) 7 
x (4) = (0.068978, 0.2464442, 0.076929) r 
x (5) = (0.068978, 0.246442, 0.076929) r 


Hence, the solution correct to six decimal place is obtained after five iteration. 

Convergence of Newton’s Method 

Newton’s method converges quadratic ally. When carring out this method the system converges quiet rapidly 
once the approximation is closed to the actual solution of the nonlinear system. This is seen as a advantage because 
Newton’s method may require less iteration, compared to another with a lower rate of convergence to reach a solution. 
However, the system does not converge, this is indicator that an error in computations has occurred, or a solution may not 
exist. 

In the following proof, we will prove that Newton’s method does indeed converge quadratic ally 

Proof of Newton’s Method Quadratic Convergence 

In order for Newton’s method to converges quadratic ally, the initial vector X (0) must be sufficiently close to a 
solution of the system F=0, which is denoted by B, .As well, the Jacobean matrix at must not be singular, that is J{x) 1 
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must exist. The goal of this proof to show that 

\\x« +i) -d 


= X Where X denote any positive constant 


x (k) -a 


We have 


(*+ 1) || _ ly (fc+i) _ p || _ || v (*) _ rhv (*) 




||X W -£-J- l (X w )F(X 


We set U (i) = X ( J 


(K) 


,(*+1) _ L(*) T-ls v (K) 


\e w -J~\X (K> )F{X (K) ) 


Next we define the second -order Taylors series as 


F(X ck) ) = ,F(#) + ./(x < * > )(e c * ) ) + -(e < * ) ) r // (e (JC) ) 


Where J(x (k) ) is the Jacobean and H 


J 1 which yields 


a 2 / 

C).X; C)X , 

* y 


l 


(3.22) 


(3.23) 

We then have to multiply each side of the Taylors series by 


<•] 


J~ l F{X (K) ) = J-\F(%) + J(X (K) )e iK) +-(e m ) T H e (k) ] 
= e {k) +- J~\e (k) ) T H e (k) 


■(3.24) 


Using (3.22) and (3.24), we obtain our last results such that 


X (r+1) -£ = L<™> 


^J~ l (e w ) T H(e w ) 


1 


<- 7 " fl e 


w 


,(«+i) 


,(« 


< L/“‘ II//II = A > 0 


This show that Newton’s method converges quadratic ally 
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Advantages and Disadvantage of Newtons method 

One of the advantage of Newtons method is that not too complicated in form and it can used to solve a varity of 
problems. The major disadvantage assocaited with Newtons method is that 

J(x),as well as its inversion has, to be calculated for each iteration. Calculating both the Jacobian matrix and its 
inverse can be quite time consuming depending on the size your system. Another prolbem that we may be challanged with 
when using Newtons method is that it may fail to converge. If Newtons method fail to converge this will results in 
oscillation between points. 

CONCLUSIONS 

From this seminar, it is safe to say that numerical methods are a vital strand of mathematics. They area powerful 
tool in not only solving nonlinear algeberic and trancedental equations with one variable,but also system of nonlinear 
algeberic and transedental equations. Even equations or systems of equations that may look simlistic in form, may in fact 
need the use of numerical methods in order to be solved. In this paper, we only examined two methods, however.there are 
several other ones that we have yet to take a closer look at. 

The main results of this paper can be highlighted in to two different areas:Convergence and the role of Newtons 
and fixed point iteration methods. With regards to convergence, we can summarize that a numerical method with a higher 
rate of convergence may reach the solution of a system in less iteration in comarsion to another method with a slwoer rate 
convergence. For example,Newtons method converges quadratically and fixed point iteration method converges 
linearly. The implication of this would be that given the exact nonlinear system of equations denoted by F,Newtons method 
would arrive at the solution of F=0 in less iteration compared to Fixed point iteration method. 

After all the material examined in this seminar, we can conclude that numerical methods are key componet in the 
area of nonlinear mathematics 
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